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ONR-AMPP  Goals  and  ASDL  Objectives 

Overall  ONR  Goal  (AMPP  program) 

Develop  methods  for  measuring  and  predicting  affordability  during 
S&T  investment  decision  making  for  optimal  resource  allocation 


Results  of  Georgia  Tech  ASDL  Research  Grant 

•  A  comprehensive,  structured,  and  transparent  decision  making 
methodology  has  been  developed  to  guide  S&T  investment  and 
resource  allocation,  with  the  capability  for  risk  reduction,  total 
ownership  cost  reduction,  and  performance  improvement. 


•  The  baseline  tool  created  to  implement  this  process  is  called  TIES: 
the  Technology  Identification,  Evaluation,  and  Selection  tool 
TIES  is  the  research  testbed  as  well  as  research  product  ! 
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MUeM 


ONR  Grant:  ASDL  Ph.D.  Studsnt^taftBJUPPQjrt., . 

Number  of  Ph.D.  Students  Supported:  8 

Ms.  Debora  Daberkow  (ASDL)  Mr.  Oliver  Bandte  (ASDL) 

Ms.  Danielle  Soban  (ASDL)  Mr.  Andy  Baker  (ASDL) 

Ms.  Elena  Garcia  (ASDL)  Ms.  Linda  Wang  (ASDL) 

Ms.  Shobana  Murali  (Math)  Mr.  Noppadon  Khiripet  (EE) 

Number  of  Masters  Students  Supported:  8 

Multidisciplinary  Professional  Team:  4 

Dr.  Dimitri  Mavris  (AE)  Dr.  Daniel  DeLaurentis  (AE) 

Dr.  Dan  Schrage  (AE)  Dr.  Mark  Hale  (AE) 

Dr.  Leonid  Bunimovich  (Math)  Dr.  George  Vachtsevanos  (EE) 

Dr.  Jimmy  Tai(AE)  Dr.  Ivan  Burdun  (AE) 

+  Over  40  students  exposed  to  methods  in  graduate  design  curriculum 
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Science  &  Technology  Return  on  Investment  (ROI) 


An  Alternate  Evaluation  Criterion: 


9  Benefit  <  9  Cost  Savings  _  9  Risk  Reduction 

9  S&T  Investment  '  9  S&T  Investment  '  9  S&T  Investment 


ROI  Assesses  the  impact  that  the  S&T  investment  made  on 
the  system  performance,  survivability,  safety, ..., 
developmental,  production,  support  life  cycle  cost  and  on 
averting  or  reducing  risk  or  by  improving  the  readiness 
associated  with  a  given  technology. 
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Technical  Areas  of  Research 


ASDL's  research  for  the  ONR  presented  here  falls  in  the  following  categories: 

X  Decision-Making  methods  for  Affordability,  with  and  without  modeling  and 
simulation  capabilities.  This  area  includes: 

♦  analysis  of  alternative  concepts  and  technologies 

+  joint  multivariate  probability  models  for  decision  making 

♦  multi-attribute  methods  such  as  TOPSIS 

♦  decision  tree  networks  with  fuzzy  inputs . 

Affordability  measurement  and  prediction  (forecasting)  of  future  technology 

*  options,  in  the  presence  of  a  variety  of  uncertainties.  This  area  includes: 

♦  Use  of  Response  Surface  Models  of  physics-based  analyses 

♦  Uncertainty  modeling  and  use  of  Fast  Probability ’  Integration  (FPI) 

♦  Preliminary'  research  into  stochastic  models  and  methods 

A.  Concurrent,  physics-based  modeling  of  system  requirements  and  technologies 

*  ♦  Nonlinear,  constrained  equation  solver  for  feasible  solutions  that  trade 
requirements  and  technology  levels 

All  three  of  these  areas  are  encompassed  in  the  overall  TIES  environment 
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Review  of  Year  1  Results 


An  innovative,  comprehensive  method  for  engineering  decision  making  was  created,  the 
Technology  Identification,  Evaluation,  and  Selection  (TIES)  method,  populated  by: 

♦  Problem  Definition/Brainstonning  Tools:  QFD,  Morphological  Matrix,  Pugh  Matrix 

♦  Intelligent  Modeling  &  Simulation  and  Technology  Impact  Forecast  through 

Response  Surface  Methods 

♦  Method  for  rapid  assessment  of  technical  feasibility :  and  economic  viability 

♦  Multi-attribute  decision  making  methods  (MADM) 

♦  Initiation  of  a  Joint  Probability  Decision  Making  (JPDM)  model 

Investigation  of  Advanced  Math  and  Soft  Computing  Techniques 

♦  Review  and  classification  of  nine  emerging  techniques 

♦  Comparative  study  of  Neural-Network  and  Response  Surface  approximations 

♦  Employment  of  Fast  Probability  Integration  (FPI)  techniques  to  assist  in  probabilistic 

formulation 

«  Review  of  advanced  tree-network  formulations  for  decision-making  under  uncertainty' 
and  schedule  constraints 
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Summary  of  Year  2  Results 

1.  Significant  enhancements  to  the  TIES  affordability  environment  est.  in  Year  1 

♦  Pilot  Studies:  Environment  prototype  for  Navy's  F-18C,  NASA's  HSCT,  a  notional 
150  pax  transport,  and  a  short-haul  civil  tiltrotor 

♦  JPDM  incorporation  and  validation;  n -variate  math  model  constructed 

♦  Genetic  Algorithm  for  technology  combinatorial  selection  problems 

♦  Fuzzy  Decision  tree  constructed  to  treat  stochastic  affordable  technology  selection 
problem,  an  evolution  of  TIES  to  include  schedule/cost  as  well  as  peiformance 

2 .  Completion  of  the  investigative  research  into  mathematical  and  soft  computing 
techniques  and  stochastics,  resulting  in: 

♦  Web-based  database  of  advanced  math  and  soft  computing  techniques  relevant  to 
affordability  measurement  and  prediction,  including  current  investigators,  computer 
codes,  and  transition  status 

♦  Several  implementations  of  methods  (Fuzzy  sets,  GA ’s,  Neural  Networks) 

♦  Roadmap  towards  stochastic  methods  established,  research  goals  prioritized 

3.  A  powerful  mathematical  tool  to  examine  the  simultaneous  impact  of  vehicle 
requirements  &  technologies  has  been  created  and  initially  tested  on  a  F/A-18C  case, 
including  carrier  suitability  constraints. 


4.  Methods  have  been  integrated  in  Graduate  level  curriculum 
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Research  Payoffs:  Value  Added  to  USN 


•  Tradeoff  requirements  vs.  technologies  early  in  design  and  procurement 
phases,  with  implications  for  Navy  Total  Cost  of  Ownership  (TOC)  reduction 
•  Ability  to  identify  and  assess  the  impact  of  new  technologies  for 
Resource  allocation  planning 

•  Probabilistic  assessment  of  design,  technological,  and  operational 
uncertainty 

•  Efficient  system  feasibility  and  economic  viability  assessment 

•  Reduction  in  design  cycle  time  and  cost 

•  Design  for  affordability  in  an  IPPD  environment 

•  Design  for  “cost  as  an  independent  variable”  ( CAIV)  as  a 
stochastic  process 

•  Initial  implementation  of  affordability  methods  to  F/A-18C 
and  NASA’s  HSCT,  with  further  validation  on  Navy  systems 
proposed 
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Section  2 


1.  Introduction  and  Research  Setting/Summary 

2.  Overall  Technical  Approach  for  Affordable  Systems  Design 

-  Feasibility /Viability  Examination  and  the  TIES 
Method  for  Affordable  Technology  Investment 

3.  Methods  Implementation  and  Testbed  Applications 

4.  Key  Advancements  in  Method  Components 

5.  Conclusions/Summary 
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1) 


2) 


Decision  Making: 

Two  Avenues  for  Technology  Assessment 

Subjective  Rankings  through  OFD,  Pugh  Diagrams,  and  Multi- 

Attribute  Decision  Making  (MADM) 

•  DoD  guiding  documents  (e.g.  DTAPS)  &  expert  opinion  are  used  to  establish 
a  mapping  of  the  Navy's  warfighting  structure 

•  Through  Quality  Function  Deployment  (QFD)  and  Pugh  Diagrams,  this 
mapping  is  used  to  subjectively  assign  importance  weights  to  various 
technologies  accounting  for  joint  warfighting  needs 

•  Multi-Attribute  Decision  Making  (MADM)  techniques  use  results  to  guide  the 
decision  maker  to  the  best  solutions 

Modeling  &  Simulation  (M&S)  and  Joint  Probabilistic  Decision 

Making  (JPDM) 

•  Engineering  analyses  and  physics-based  models  of  technologies  are 
employed  in  order  to  obtain  objective  estimates  of  technology  impacts 

•  Probabilistic  analysis  techniques  captures  uncertainty  and  risk  among 
multiple,  inter-related  decision  criteria 
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Established  Techniques  +  Innovative  Methods  =  The  TIES 
Established  Techniques 

*  Response  Surface  Method  (Biology;  Ops  Research) 
Design  of  Experiments  (Agriculture,  Manuf.) 

Quality  Function  Deployment,  Pugh  Diagram  (Automotive) 

*  Morphological  Matrix  (Forecasting) 

MADM  techniques  (U.S  Army,  DoD) 

*  Uncertainty/Risk  Analysis  (Controls;  Finance) 

*  Simulation-Based  Acquisition  (DoD  Procurement) 

ASDL  Innovation 

*  FeasibilityA/iability  Identification 

*  Technology  Impact  Forecast 

*  Joint  Probabilistic  Decision  Making 

*  Stochastic  approaches 

*  Intelligent  lntegrationo=>TIES  Affordability  Meth. 
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Creation  of  a  Multi-disciplinary  Physics-Based  M&S 


Environment 


Increasing 
Sophistication  and 
Complexity 


Preliminary  Design  Tools 

(Higher-Order  Methods) 
Propulsion 
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Response  Surface  Methodology  (RSM) 


•  RSM  is  a  multivariate  regression  technique  developed  to  model  the 
response  of  a  complex  system  using  a  simplified  equation 

•  RSM  is  based  on  the  design  of  experiments  methodology  which  gives 
the  maximum  power  for  a  given  amount  of  experimental  effort 

•  Typically,  the  response  is  modeled  using  a  second  order  quadratic 
equation  of  the  form: 

R  =  b0  + 1 b,x,  +  f  buxf  + 1  t  bijXix , 

1=1  i~]  i—l  j=i+ 1  LJ 

Where, 

bi  are  regression  coefficients  for  the  first  degree  terms 
are  coefficients  for  the  pure  quadratic  terms 
are  the  coefficients  for  the  cross-product  terms 
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Robust  Design 


Robust  Design  is  the  systematic  approach  to  finding  optimum 
values  of  design  factors  which  results  in  economical  designs 
which  maximize  the  probability  of  success. 


A  Robust  Design  is  characterized  by: 

Technical  Feasibility  - ►  satisfies  all  technical  constraints 

for  a  given  confidence  level, 


Viability  - ►  customer’s  economic  targets  are 

also  met 
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Fast  Probability  Integration  (FPI) 


FPI  manages  program  execution  while 
handling  up  to  100  deterministic  (Xj)  or 
probabilistic  (y)  variables,  with  capability  for 
expansion 

Establishes  design  feasibility 
Identification  of  most  critical  constraints 
Creates  probabilistic  sensitivity  derivatives 
and  CDFs  for  each  objective  &  constraint 
Assessment  of  new  technologies  impact 
deterministically  or  probabilistically 
Probabilistic  solutions  for  a  set  of  design 
x,  variables  subject  to  uncertainty 

Identification  of  feasible  and/or  robust  solutions,  by  assigning  random 
distributions  to  each  design  variable,  within  the  range  of  applicability,  and 
allowing  for  operational  and  manufacturing  uncertainty 
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Characterizing  the  Feasibility/Viability  Method 

Q1 ;  What  are  the  measures  of  success  ? 

Q2:  Is  a  new  technology  needed  ?  i.e.  Can  optimization  satisfy  the  requirements  ? 

Q3a:  What  constraints  are  being  violated  ? 

Q3b:  Can  constraints  be  relaxed  ? 

Q3c:  Can  requirements  be  relaxed?  Can  they  be  manipulated/examined  simultaneously  ? 
Q3d:  What  discipline  metric  is  responsible  for  this  violation  ? 

Q4a:  What  is  the  mapping  between  technologies  and  metrics,  including  adverse  effects  ? 
Q4b:  What  is  the  confidence  associated  with  a  technology  estimate  ? 

Q4c:  What  is  the  optimal  resource  allocation  (including  combinations  of  technologies)  ? 
Q4d:  Multi-Attribute  Decision  Making  methods  (MADM)  yields  best  mix  of  technologies  ? 

Q5:  With  technologies  and  confidence  estimates  chosen,  return  to  full  analysis.  Can  final 
design  space  exploration  and  robust  design  optimization  improve  the  result  ? 
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Technology  Identification  Evaluation  Selection  (TIES) 

Pugh  Evaluation  Matrb\ 


QFD , 


Tech.  Alternative 
Identification 


1  oofs' 

]Stor  each  criterion 
or  objective 

[  CDF^~ 

Srcr  each 
constraint  r 

Monte  Carlo 


•  objectives 

•  metrics 

•  constraints 
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Pugh  Evaluation  Matrix 
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Technology  Impact  on  Metrics 


•  New  technology  opens  the  range  of  the  affected  metric  through  a  k-factor: 

L/Dnew  =  kj^o  L/Dold  ;  where  k^  =  0.9  ...  1.2  is  based  on  Question  10. 

•  Select  ranges  for  ail  metrics  affected  by  new  technologies 

•  The  technology  is  applied  to  a  fixed  baseline  configuration 

•  Create  a  DoE  to  establish  ....  for  each  new  technology  considered _ 


^■L/Dsub 

KL/Dsup 

^SFC 

K 

$/RPM 

TOGW 

V 

app _ 

Rn 

.9 

1.05 

0.95 

0.125 

809,781 

119 

.9 

1.05 

0.85 

0.129 

825,432 

121 

.9 

0.85 

0.95 

0.137 

755,593 

117 

.95 

0.85 

0.85 

0.133 

791,024 

122 

: 

: 

• 

j 

: 

•  Create  RSE  based  on  uncorrelated  metrics,  since  configuration  is  fixed  and 
metric  improvements  (k^s)  are  selected  independently 
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Technology  Estimates 
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Addressing  Technology  Benefits, 
Penalties  and  Confidence 


1 .  Create  functional 
relationships  between 
Objcctives/Constraints 
and  technology  metrics 

2.  Model  technology 
benefits  and  penalties 
through  metric  “k-factors” 

3.  Assign  probability 
distributions  to  the 
technology  metrics  to 
develop  confidence 
estimates  and  CDFs 


Objective  =  f(L/Dcruise, 
Constraint  =  f(L/Dcruise, 
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(Variability) 
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Technology  Identification  Evaluation  Selection  (TIES) 
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Pugh  Evaluation  Matrb\ 
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A  MADM  Choice:  TOPSIS 


Technique  for  Order  Preference  by  Similarity  to  Ideal  Solution  (TOPSIS) 

-  compensatory  and  compromising  method  utilizing  preference  in  the  form  of 
weights  Wj  for  each  criterion 

-  best  alternative  has  shortest  distance  to  ideal  solution  and  farthest  away  from 
negative-ideal  solution 

Advantages: 

-  simplicity 

-  indisputable  ranking  obtained 
Disadvantages: 

-  dependent  on  cardinal  information,  such  as  weights 

-  solution  highly  dependent  on  values 

-  criteria  have  to  have  a  monotonically  increasing  or  decreasing  utility  to  the 
decision-maker 
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Multi-Attribute  Decision  Making  (MADM) 

Ranked 
Alternatives 


Pugh  Matrix 
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Section  3 


1.  Introduction  and  Research  Setting/Summary 

2.  Overall  Technical  Approach  for  Affordable  Systems  Design 

3.  Methods  Implementation  and  Testbed  Applications 

-  Design  Space  Exploration  (Feasibility  Determination  for  a  High  Speed  Civil  Transport) 
.  TIES  Implementation  ( Technology  Selection  for  an  Advanced  ISOpax  Transport ) 

-  Joint  Probabilistic  Decision  Making  (JPDM) 

.  Simultaneous  Examination  of  Requirements  and  Technologies  ( F/A-18C  Testbed) 

4.  Key  Advancements  in  Method  Components 

5.  Conclusions/Summary 
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High  Speed  Civil  Transport  (HSCT) 

n rraa w .T'/ir,' ?*«•*  - *..  *”«'*'-*  •' v  <m  \  *  .*  m&i  iv..k  .*'v- 


Cruise  Mach  Number  of  2.4 
Range  of  5000  nm. 

Carry  300  passengers 

Powered  by  four  engines  capable  of  cruising 

supersonically  without  afterburner 

Able  to  make  two  round  trips  to  Europe  or  Pacific  Rim  in 

the  same  amount  of  time  as  one  trip  for  a  subsonic 

transport 
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HSCT  Challenges 


Environmental  Constraints 

-  Engine  that  is  sized  to  cruise  violates  FAA  noise  regulations 

-  Nitrogen  Oxide  emissions  harm  the  ozone  layer 
Performance  Constraints 

-  Poor  takeoff  and  landing  characteristics 

-  High  Mach  numbers  require  special  heat-resistant  materials 
Economic  Constraints 

-  Will  require  a  fare  premium  J 

-  Will  have  a  high  acquisition  cost  //  ^ 

-  Will  require  a  large  initial  investment  A  [  Y 
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High  Speed  Civil  Transport  (HSCT) 

•  •  •  - ^ -  -<c  ~  1  ' 


XI 

1.54 
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1.69 

Kink  IE  x-location,  normalized  by  wing  semi-spar 

Y1 

0.44 

0.51 

0.58 

Kink  L.E  y-location,  normalized  by  wing  semi-spar 

X2 

2.10 

2.23 

2.36 

Tip  IE  x-location,  normalized  by  wing  semi-span 

X3 
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2.49 

2.58 

Tip  TE  x-location,  normalized  by  wing  semi-span 

X4 

2.19 

2.275 

2.36 

Kink  TE  x-location,  normalized  by  wing  semi-spar 

X5 

2.19 

2.345 

2.50 

Root  Chord,  normalized  by  wing  semi-span 

XWING 
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wing  position.  %  fuselage  length 

SW 
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wing  ref.  area,  square  feet 
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82% 
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87.4% 

horizontal  tail  position,  %  fuselage  length 

ST 
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922.5 
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horizontal  tail  ref.  area,  square  feet 

XHT1 

0.95 

1.18 

1.20 

normalized  by  HT semi-span 

XHT3 

1.90 

2.00 

2.10 

normalized  by  HT  semi-span 

CG 

56% 

57.5% 

59% 

CG,  %fuselage 
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Prediction  Profiles  for  the  HSCT 


l)r.  Dimitn  Mavris  /  Dr.  Dan  Del  jruremis 
Georgia  Institute  of  Technology 
Atlanta.  GA  30332-0150  — 


1999  ONR  Grant  Review-  Aerospace  Systems  Design  Laboratory  (ASDL) 


CDFs  for  the  Four  Constraints, 

from  Monte  Carlo  Simulation  (5,000  samples) 


All  constraints  violated  throughout  initial  design  space 


2.188  12.875  13. 3W 

Takeoff  Field  Length  (TOFL),  ft.  Ryover  Noise  (FON).  EPNLdb 


Sideline  Noise  (SLN),  EPNLdb  Approach  Speed  (VAPP).  kts. 
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Pareto  Charts:  Mission  Requirements  Sensitivities 
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Feasibility  and  Viability  Assessment 

•  If  design  space  is  not  technically  feasible  or 
economically  viable,  the  decision  maker  has  3 
options: 

1)  Open  design  variable  ranges  further 

-  Design  Space  Exploration  yielded  no  improvement 

2)  Relax  constraints 

-  N on-negotiable  in  this  case 

3)  Infuse  new  technologies  ! ! ! 
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Technology  Identification  Evaluation  Selection  (TIES) 
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Modeling  &  Simulation 


Response  Surfaces 
R  =  f(k1,  k2,  ...) 


TIP  Environment 
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Example  Problem 

•  The  implementation  of  the  feasibility  aspect  of  TIES  has 
been  performed  on  various  vehicles 

•  The  down-select  of  the  specific  technologies  is  the  new 
dimension  of  the  TIES  method  and  will  be  applied  for  the 
example  problem 

•  The  proof  of  concept  is  performed  on  a  150  passenger, 
medium-range,  intra-continental  commercial  transport  and 
the  technologies  are  evaluated  deterministically 

•  See  SAE  Paper  98-5547  for  the  feasibility  assessment, 

SAE  Paper  98-5576  for  the  TIF,  and  AIAA  99-0183  for  the 
joint  probability  decision  making 
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Problem  Definition:  1 50  passenger  concept 


Medium  Range,  Intra-continental  Commercial  Vehicle 


3000  nm  +  added  FAA  250  nm 


27 


Problem  Definition:  Quantitative  System  Level  Metrics 
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Technology  Impact  Matrix 


Potential  system  and  subsystem  level  benefits  and  penalties  associated 
with  the  technologies  identified  in  the  Morphological  and 
Compatibility  Matrices  are  established  via  expert  questionnaires, 
physics-based  modeling,  or  literature  reviews 

In  general,  benefits  and  penalties  are  probabilistic  (possibly  stochastic) 
in  nature 

Technology  impact  can  be  simulated  in  the  TIF  environment  through 
technology  “k_factor”  vectors  and  summarized  in  a  TIM 

where  a  technology  can  be  represented  as: 

.....  i - 1  1  "!ktc:  ... _ 


Technical  "K" 
Factor  Vector 

T1 

T2 

T3 

k  factor  1 

+4% 

~ 

-107c 

k  factor  2 

-3  7c 

- 

k  factor  3 

-17c 

-2% 

k  factor  4 

-2% 

-27c 

+37c 

T=k,  = 


2 


where: 

"i"  :  specific  technology 
”n":  number  of  k_factors 
“p”:  mean  of  the  k_factor 
“a":  variance  of  the 
k_factor 

“TRL‘r:  technology 
readiness  level 
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Constraint/Objective  = 

=/(kp  k2 . .  kn)  as  obtained  from  a  Design  of  Experiments  to  obtain  a 

second  order  equation  of  the  form: 

k  k  k- 1  / 

R  =  ba+  YM  +  Lbnk?  +XZ  W, 

i=\  t=l  /=!  ;= 
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Technology  Evaluation 

}  ->~v<<  »  V  .  5  m  RRiajjr»  *s  ‘  *•  m»  JWftfF 

•  The  identification  of  the  proper  mix  of  technologies  for  a 
given  system  is  dominated  by  the  curse  of  dimensionality 

•  Curse  o^Dimensjonality:  the  search  for  the  proper  mix  of 
technologies  which  will  “best”  satisfy  the  system  level 
metrics  or  attributes  can  be  enormous 

-  2n  combinations,  where  “n”  is  the  number  of  technologies 

•  9  technologies  implies  512  combinations 

•  20  technologies  implies  1,048,576  combinations 

-  Computational  expense  of  the  analysis  is  the  primary  driver 

•  manageable :  full  factorial  investigation 

•  unmanageable :  genetic  algorithm  investigation 
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1999  ONS  Grants 

Technology  Resource  Allocation 

•  Based  on  the  TIES  method  results,  the  most 
influential  individual  technologies  can  be 
compared  to  the  baseline  metrics  in  an  efficient 
and  rapid  manner 


•  The  most  influential  technologies  can  be  identified 
so  as  to  optimize  program  resource  allocation  for 
technology  research  and  development  to  overcome 
constraints  or  meet  objectives 
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Technology 


Resource  Allocation 


TOGW 


Technologies: 

Tl:  Composite  Wine 
T2:  Composite  Fuselage 
T3:  Aircraft  Morphing 
T4:  NLFC 
T5:  Maneuver  Load 
T6:  AST  Concept 
Engines 

T7:  ISSA  Structures 
T8:  HLFC 

T9:  IHPTET  Engines 
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Technology  Resource  Allocation 

W'  *  **"*  * 

TAROC 


T9 
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Technologies: 


Tl:  Composite  Wing 
T2:  Composite  Fuselage 
T3:  Aircraft  Morphing 
T4:  NLFC 
T5:  Maneuver  Load 
T6:  AST  Concept 
Engines 

T7:  ISSA  Structures 
T8:  HLFC 

T9: 1HPTET  Engines 


Dr  Dimitri  Mavris/Dr.  Dan  DcLaurentis 
Georgia  InUituie  of  Technology 
Atlanta.  GA  30332-0150 
www  asdl.gatech  edu 


I 

*M...  .«lv 

A-.fi--* 

*<?<■& 

r-}f 

>  -  - 1 

i 

\ .  r 

.  i  I 

1 

j 

1  i  l 

i 

i 

_ n 

- - - ]  —  1 

i  i  ; 

■  j 

■ 

;  ! 

Jd 

P 

i 

i  j 

i 

rjp 

i  ■ 

j - - - - 

. 

-8 

-6  *4 

_2 

0 

2 

4 

%  Reduction  in  Total  Airplane  Related  Operating  Costs  from  Baseline 
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MSDL 


Technologies: 

Tl:  Composite  Wing 
T2:  Composite  Fuselage 
T3:  Airaaft  Morphing 
T4;  NLFC 
T5:  Maneuver  Load 
T6:  AST  Concept 
Engines 

T7;  ISSA  Stmaurcs 
T8:  HLFC 

T9:  IHPTET  Engines 


Top  Alternatives 

Evaluation  Based  on  Minimum  TOGW 
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Technologies: 

T1 :  Composite  Wing 
T2:  Composite  Fuselage 
T3:  Aircraft  Morphing 
T4:  NLFC 
T5:  Maneuver  Load 
T6:  AST  Concept 
Engines 

T7: 1SSA  Structures 
T8:  HLFC 

T9:  IHPTET  Engines 


Top  Alternatives 

Evaluation  Based  on  Minimum  TAROC 
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“Best”  Alternative 
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Genetic  Algorithm  Investigation 

i 

•  A  simple  deterministic  proof  of  concept  was 
performed  with  a  genetic  algorithm  (GA)  for  the 
equal  weighting  OEC 

•  The  identical  mix  of  technologies  from  the 
TOPSIS  technique  was  obtained 

•  Future  work  will  focus  on  application  of  the  GA 
method  with  probabilistic  k_factor  vectors  and 
multi-attribute  and  conflicting  objectives 


_ _ _ asm  lit* 
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Genetic  Algorithm  Implementation 


•  Identify: 

-  Number  of  Technologies 

-  Number  of  Subsystems 

-  Number  of  Metric  Responses 

•  Specify/Provide: 

-  Technology  Impact  Matrix  (TIM) 

-  Compatibility  Matrix 

-  Computation  Metamodels  for  Metric 
Response 

-  Multi-Attribute  Decision  Making 
Strategy 

•  GA  yields: 

-  best  combination  of  technologies 
based  on  identified  measures  and 
provided  information 
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Conclusions 


•  A  methodology  for  the  systematic  down-select  of 
the  proper  mix  of  technologies  which  satisfies  the 
imposed  system  level  metrics  was  established 

•  Method  could  be  interpreted  for  resource 
allocation  of  various  technologies 

•  Future  work  will  focus  on: 


-  probabilistic  and  stochastic  evaluation 

-  multi-attribute  decision  making  with  conflicting 
objectives 

-  more  technology  combinations  for  GA  implementation 

-  other  vehicle  concepts 
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Multi  Criteria  Decision  Making 
Technique  for  Systems  Design: 
Joint  Probabilistic  Decision  Making 

(JPDM) 
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Hypothesis:  Multi  Criteria 

3,:  zr&$  isms '  '■■'  &  «& r<'  ;>^>?  ^  v,-*'  "-T-. :«  A r 


Motivation 

:V':s -vv/ : : ^'V:^:  ■- ;  ^ 


•  Customer  needs  translate  to  system  characteristics 
called  attributes  or  constraints  which  become 
decision  criteria  for  product  selection. 


•  Complex  systems  have  a  multitude  of  attributes, 
such  as  life  cycle  cost,  gross  weight,  excess  power, 
safety,  dependability,  etc. 

•  Decisions  based  on  one  criterion/attribute  may 
yield  products  with  poor  performance  in  other 
attributes. 


A  design  method  is  needed  that  accounts  for  all 
criteria  concurrently. 
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Hypothesis:  Probabilistic 


Motivation 

5&&SSS3  •: : ; ^AAl SSS5S5  \ -■ 


•  Most  assumptions  made  about  the  operational 
environment  of  the  system  are  uncertain. 

s  Deterministic  assumptions  misrepresent  the  actual 
behavior/knowledge . 

•  Computer  model  fidelity  introduces  uncertainty  in  the 
output  prediction. 

•  Use  of  new  technologies  adds  uncertainty  due  to 
readiness/availability. 


A  probabilistic  formulation  of  the  design  process  is 
needed  to  capture  and  analyze  uncertainties. 
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Typical  Design  Questions 


•  How  to  compare  different  design  solutions 
with  multiple  objectives  on  an  equal  basis. 

•  How  to  compare  different  design  solutions 
despite  uncertainty  about  relevance  and 
accuracy  of  design  assumptions. 

•  How  to  trade  one  requirement  for  another. 

•  How  to  determine  optimal  solutions  based  on 
multiple  objectives. 
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Shortcomings  of  Existing  Decision  Aids 


Current  multi  criteria  approaches  determine  either  just  the  best 
solution  of  a  small  finite  set  based  on  many  criteria,  called 
Multi  Attribute  Decision  Making  (MADM),  or  the  best  solution 
of  an  infinite  set  based  on  just  a  few  criteria,  called  Multi 
Objective  Decision  Making  (MODM). 


P roposed  Method 


■s  -. « ■'*.; ,  izm '  m  '  &&ti  m 


Joint  Probabilistic  Decision  Making  (JPDM) 

•  Combines  advantages  of  probabilistic  treatment  of 
uncertain  information  with  multi  criteria  decision 
making. 

•  Determines  the  probability  of  satisfying  all 
(specified)  customer  needs/criteria  values  as  an 
objective  function  within  TIES. 

•  Facilitates  visual  trade-offs  for  two  requirements  at 
a  time. 
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Four  $ 

Steps  for  Implementing  JPDM 

Step  1: 

Determine  objectives/requirements  of 
customer  and  designer. 

Step  2: 

Assign  probability  distributions  to  design 
assumptions  (fix  design/control  variables). 

Step  3: 

Run  analysis  and  determine  joint  probability 
distribution  of  criteria  and  requirements. 

Step  4: 

Dr.  Dimitri  Mavris/  Dr  Dan  DeLaurentis 
Georgia  Institute  of  Technology 

Determine  solution  with  highest  joint 
probability  (two  problems:  MADM  or 
MODM). 
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Joint  Probability  Density  Function  -  2D 
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Implementation  (cont’d) 

Step  1: 

Determine  objectives/requirements  of  customer  and 
designer. 

Step  2: 

Assign  probability  distributions  to  design  assumptions 
(fix  design/control  variables). 

Step  3: 

Run  analysis  and  determine  joint  probability 
distribution  of  criteria  and  requirements. 

Step  4: 

Determine  solution  with  highest  joint  probability  (two 
problems:  MADM  or  MODM). 
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Empirical  Distribution  Function  (EDF) 


Estimates  probability  of  occurrence  of  a  specified  event  based  on  sample 
events. 

Counts  how  many  times  the  event  occurred  in  the  sample. 

Denoted  for  one  variable  and  sample  xi?  i=l  to  n  by 

*  1  if  true 

Density  function:  =  I(xi=  a)  ={  o  if  false 


1=1 


Cumulative  function:  Fx(a)  =  /(*,.  <  a)  I(xi  —  -{ * 

f=i 

Joint  cumulative  formulation,  sample  (Xj^Zj),  i=l  to  n: 

Fxyz {a,b,c)  =  ^l(xi<a,  y,  <  b, z,  <  c) 

i= 1 


=  (  1  if  true 
if  false 
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EDF  -  Advantages/Disadvantages 

*  Advantages: 

-  Most  exact  method 

-  Does  not  need  approximation  with  standard  distributions 

-  Estimates  joint  probability  from  data  directly 


•  Disadvantages: 

-  Needs  large  amount  of  data  to  be  accurate 

-  Requires  modeling  and  simulation 

-  Availability  of  data  in  conceptual  and  preliminary  design  may  be 
limited  or  too  expensive 

-  Joint  probability  estimation  itself  is  more  time  consuming 
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Joint  Probability  Model  (JPM) 


•  Analytical  model  to  estimate  multivariate  joint  probability. 

•  Uses  statistics  of  marginal  distributions  (mean  p  and  standard  deviation  a). 

•  Uses  correlation  coefficients  of  criteria. 

•  Allows  continued  use  of  techniques  that  estimate  marginal  distributions. 

•  Example  for  bivariate  normal  model: 


fxy(a,b)  — 


exp{- 


2tc<jx<ty^\-  p2  2p2-2  ox 

Formulation  for  n- variate  normal  model: 


-  2p(^L)(*Z£L)  +  {tJL 


)2]} 


/(x;n,E)  = 


[  c-g.(»:pJ)/2 

(2nyA\lf 

xe9T  £ 


Qn  (x;  \i,  E)  =  (x  -  n/E-1  (x  -  ji), 

=  Correlation  Coefficient  Matrix 
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JPM  -  Advantages/Disadvantages 


Advantages: 

-  Needs  limited  information  for  execution 

-  Can  employ  expert  guesses  in  case  of  lack  of  simulation 

-  Fast  evaluation  of  joint  probability 

-  Method  can  be  used  in  conceptual  or  preliminary  design 

Disadvantages: 

-  Requires  approximation  of  actual  data  by  standard  distribution 

-  Requires  correlation  coefficient,  which  may  not  be  available  in 
early  stages  of  design 
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Step  3  -  Exeuction  Accuracy  Vs.  Efficiency 


Problem  Definition 
Attributes 


Modeling  and 
Simulation 


Monte-Carlo 

Simulation 


Empirical 

Distribution 

Function 


cdf  r— 

Regression!  Matrjx 


Joint 

Probability 

Model 


Response  Surface 
Equation 

Ml 

Monte-Carlo 

Simulation 


Empirical 

Distribution 

Function 


Joint 

Probability 

Model 


Advanced  Mean  Correlation 

Value  Method  Coefficient 

- Matrix 
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Joint 

Probability 

Model 


Most 
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Results  -  Method  I 


Monte  Carlo  Simulation 

10,000  samples 

LCC  TOGW 


Joint  Probability  Distribution 


10.5% 

5.3% 

43.8% 


2.3% 

1.2% 

12.5% 


14% 

TOGW 


Empirical  Distribution  Function 

VJ7o 

10.000 

f  (LCC, TOGW )  =  £  I  (LCC  -e<  lee, ,  <  LCC  +  e,TOGW -£<  to  gw,  <TOGW  +£) 


Di.  Dimitri  Mavri* /  Dr  Dan  PcLauremis 
Georgia  Institute  of  Tech  no  log  v 
Atlanta.  GA  30332-0150  — — ■ 

vwv  aedl . gatech .«du 


1999  ONR  Grant  Review -  Aerospace  Systems  Design  Laboratory  (ASDL) 


Results  -  Method  II 

Monte  Carlo  Simulation 


10,000  samples 

LCC  TOGW 


Joint  Probability  Distribution 


10.5% 

5.3% 

43.8% 


2.3% 

1.2% 

12.5% 


H= 29.23%  p=6.70% 

0=7.69%  0=1.77% 


fxy(a’b) — 


1 


14% 


TOGW 


, _ =exp{— — j — — [(— — — )2  -  2p(r-^-)(— — — )  +  (^)2 ) } 

27tax<Ty^\  -  p2  2p  -2  crx  ox  <J¥ 
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c 

omparison  of  Meth 

iods 

*  Kr>%  ■ 

•  Good  agreement  of  Response  Surface  Equation/Monte  Carlo  Simulation 
method  and  Monte  Carlo  Simulation  directly  on  analysis  code. 

•  Both  distributions  are  approximated  well  by  the  normal  distribution  (due  to 
nine  input  variables  and  the  Central  Limit  Theorem). 

•  Normal  approximation  will  be  even  better  for  non-uniform  input 

distributions. 

LCC _ 

.015 

□  Normal  Distribution 

p  =  6.7%  c  —  1.77% 

.012 

/  \ 

bMCS 

.008 

j  V.  . 

.004 

xr 

■  RSE/MCS 

.000 
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Comparison  of  Methods  (contd.) 


Comparison  of  means  and  standard  deviations  shows  similar 
prediction  capability  of  methods. 

I  MCS/JPM  RSE/JPM  %  Difference  AMV/JPM  %  Difference 


Ulcc 

JJtogw 

Olcc 

OtOGW 

Correlation 


29.23% 
6.70% 
7.69% 

1 .77% 
-0.1816 

MCS/EDF  -  AMV/JPM 


28.71% 

6.66% 

7.32% 

1 .76% 
-0.1590 


-0.40% 

-0.04% 

-4.73% 

-0.60% 

-12.44% 


28.46% 
6.61% 
7.27% 

1 .73% 
(-0.1816) 

MCS/JPM  -  AMV/JPM 


-0.60% 

-0.09% 

-5.43% 

-2.53% 


TOGW 


TOGW 


LCC 


LCC 
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Implementation  (cont’d) 

Step  1: 

Determine  objectives/requirements  of  customer  and 
designer. 

Step  2: 

Assign  probability  distributions  to  design  assumptions 
(fix  design/control  variables). 

Step  3: 

Run  analysis  and  determine  joint  probability 
distribution  of  criteria  and  requirements. 

Step  4:  ^ 

^ :  Ipfeter^  probability  {twbJrS^ 

problems:  MADM  or  MODM), 
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Step  4  -  MADM 


•  Rank  solutions 
based  on  joint 
probability. 

•  Select  solution  with 
highest  probability. 

•  Conduct  “What-If” 
studies  for 
requirements/ 
criteria. 


Criterion  2 

-I*  ^ 

/ 

Criterion  2 

rc ,  v**,  ' 

2?  ■'  :;o 

$H) 

W 

Criterion  2  ^ 

Criterion  1 

*s 

e 

e 

•c 

3 

•c 

\  u 

Criterion  1 

iilmm 

$H) 

w 

j§§| 

Criterion  1 

Criterion  1 
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Conclusions 


•  A  four  step  joint  probabilistic  decision  making  technique  was  introduced  as  part 
of  the  TIES  method. 

•  Five  JPDM  methods  (MCS/EDF,  MCS/JPM,  RSE/MCS/EDF,  RSE/MCS/JPM, 
and  AMV/JPM)  were  used  to  determine  the  joint  probability  example  study 
with  two  criteria. 

•  JPDM  technique  is  capable  of  treating  uncertain  information  of  early  stages  in 
design. 

•  JPDM  technique  introduces  new  objective  function  to  multi  criteria  decision 
making:  probability  of  meeting  all  operational  and  design  requirements 
concurrently. 

•  JPM  needs  extension  to  capture  other  than  normal  distributions. 
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5.  Conclusions/Summary 


Dr.  Dimitri  Muvris  /  Di  Dan  Del-utircnti* 
Georgia  Institute  of  Techno  Inin 
Atlanta.  GA  .Wtt-0150 
www.asdl . gateeh.edu 


1 999  ONR  Grant  Review-  Aerospace  Systems  Design  Laboratory  (ASDL) 


Section  4 


Part  A: 

Simultaneous  Examination 
of  Requirements  and 
Technologies 
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Examining  the  Role  of  Requirements 

Synopsis 

•  Requirements  drive  initial  design  studies,  procurement  decisions,  and  ultimately  operational 
effectiveness  and  cost 

•  However,  it  is  often  the  case  that  design  processes  (and  designers)  overlook  the  impact  of 
changes  and/or  ambiguity  in  requirements  and  fail  to  understand  the  relationships  between 
requirements,  technologies,  and  the  design  space 

•  ASDL  has  been  tasked  by  ONR  to  investigate  the  role  of  requirements  in  affecting  the 
design  and  S&T  investment;  and  then  to  formulate  a  method  for  examining  requirements 
simultaneously  with  design  alternatives,  technologies,  affordability,  etc. 

Tasks 

•  Link  the  appropriate  aircraft  sizing/synthesis  and  economic  tools  plus  probabilistic  methods  to 
create  testbed  environment;  model  the  F/A-18C  (using  substantiation  data  for  validation) 

•  With  F/A-18E/F  requirements  (Ref.  AIAA  Paper  98-4701)  as  drivers,  look  at  relation  of 
technology  metrics  on  requirements  mathematically 

•  Provide  ONR  with  the  unique  capability  to  examine  the  impact  of  requirements,  desirements,  and 
constraints  on  affordability  decisions 
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The  Importance  of  the  Requirements  Definition  Stage 


Design  Freedom 


Cost  Committed 


Actual  Cost 
Expenditure 


Requirements 

Definition 


Conceptual 

Design 


Preliminary 

Design 


Dr.  Dimilri  Mavris  /  Dr.  Dan  DeLaurtntis 
Georgia  Institute  of  Technology  ______ 

Atlanta.  GA  30332-0150  — — 

www.asdl .gatech.edu 


1999  ONR  Grant  Review-  Aerospace  Systems  Design  Laboratory  (ASDL) 


jsijjm 


Expanding  Missions:  The  F/A-18E/F 


Maritime 

Air 

Superiority 

Air 

Combat 

Fighter 

Fighter 

Escort 

Recce 

Close 

Air 

Support 

Air 

Defense 

Suppres¬ 

sion 

Day/ 

Night 

Attack 

All 

Weather 

Attack 

F-14D 

NATF 

F/A-18 

A/B/C/D 

A-6F 

F/A-18 

E/F 
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How  can  such  multi-role  vehicles  be 
examined  as  potential  solutions  for  the 
war-fighter  with  respect  to  technologies, 
requirements,  and  design  constraints  ? 

iW 
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Affordability:  Components  and  Definitions 

A  design  or  S&T  investment  problem  has  the  following  top  level  structure: 


Requirements  are 
thresholds  on  performance 
or  cost  metrics  which 
must  be  satisfied 
(e.g.  Mission  Radius  must  be 
greater  than  500  nm) 


Desirements  are  metrics 
which  are  desired  to  be 
maximized  (or  minimized) 
to  delineate  between 
competing  alternatives 
which  satisfy  the 
requirements 

(e.g.  Minimize  O&S  fleet  costs) 


Constraints  are  externally 
imposed  requirements 
(either  by  nature  or 
government  regulations, 
communities,  market,  etc.) 

(e.g.  Keel  must  be  of 
sufficient  strength  to  handle 
carrier  landing) 


This  structure  provides  the  starting  point  for  the  TIES  F/A- 1 8C  process. . . 
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Process 


The  traditional  process  of  identification  of  an  overall  objective  to  be 
optimized  is  replaced  by  the  following  process: 

b=^  1)  Using  Response  Surface  Method  to  mathematically  represent  combined 

requirements-technology-configuration  space 

n=5>  2)  search  for  alternatives  (configuration  changes  plus  technology  infusion)  that 
satisfy  requirements  and  constraints  ( TIES  method ) 


3)  simultaneously,  optimize  on  desirements  within  this  feasible  space 
(continuous)  or  set  (discrete)  then,  perform  sensitivity  studies  to  show  the 
perturbation  of  the  solution  due  to  possible  changes  in  requirements  and  design 
variables. 


Thus,  the  customer/decision  maker  has  information  with  regards  to  the  choice  between 
tolerating  a  relaxation  In  requirements  or  accepting  achievable  performance  levels 
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Overall  Environment  Snapshot 

Example:  Examine  a  multi-role  fighter/attack  concept 


|  2*iTOGW 
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Range  Aux  Combat  T/W  AR  h  BPR  TIT 

Fuel  Mach 

Payload  Nz  W/S  tr  i/c  OPR  Sm 


Requirements  for 
Primary  Mission 


Design/Economic 

Variables 


kCpr  kW«  kSFC 


Technology  k* 
Factors 
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Drag  Polars  for  Varying  Mach  Numbers 

Altitude  =  36,089  ft 
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Propulsion  Modeling 


F404-GE-402  Augmented  Turbofan  Engine 

The  F404-GE-402  is  an  increased  General  SQecjlic 
performance  derivative  of  the  F404  .  Thrust: 

and  is  used  in  the  F/A-18C  .  SFC  (max  A/B 

Features  a  dual-spool  mixed  flow  ,  SFC  ((Rp). 

turbofan  architecture,  3X7X1 XI  ....  ,CI  cv 

turbomachinery  configuration  *  Airflow  (bLb,‘ 

•  Weiaht’ 

F404  Engine  performance  deck  “ 

based  on  installed  engine  data  for  *  Length: 

the  F/A-18C  •  Diameter: 

Engine  performance  data  source: 

“ F/A-18C  Substantiating 
Performance  Data  with  F404-GE- 
402  Engines"  Report 
MDC91 B0290 


General  Specifications: 

•  Thrust:  17,7001b 

•  SFC  (max  A/B):  1 .74  Ibm/lbf-hr 

•  SFC  (IRP):  0.81  Ibm/lbf-hr 

•  Airflow  (SLS):  146  pps 

•  Weight:  2,282  lb 

•  Length:  159  in 

•  Diameter:  35  in 
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Weight  Breakdown-  Validation 


•  Sizing/Synthesis  Code  Used: 
FLight  Optimization  System 
(FLOPS) 

•  F/A-18C  Baseline  Modeled  in 
FLOPS  calibrated  against  actual 
substantiation  data  from 
manufacturer 

•  Highly  accurate  model  (errors 
in  weights  less  than  \%) 
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F/A18C  Weight  Breakdo 

yvn  Comparison 

Group 

F/A18C 

Baseline  Model 

Wing 

3.919 

3,918 

Tail  Group 

1,005 

1,006 

Body 

5,009 

5,009 

Alighting  Gear 

2.229 

2.228 

Propulsion  Group 

Engines 

4,420 

4.417 

Encine  Section 

Gear  Box 

921 

922 

Controls 

Stariinc  System 

Fuel  System 

1.078 

1,078 

Flight  Controls 

1,061 

1,062 

Auxiliary  Power  Plant 

206 

206 

Instruments 

84 

84 

Hydraulics 

351 

352 

Electrical 

592 

592 

Avionics 

1,864 

1,864 

Armament,  Gun,  Launchers,  Ejectors 

948 

948 

Furnishings,  Load/Handling,  Contingency 

631 

631 

Air  Conditioning 

641 

642 

Crew 

180 

180 

Unusable  Fuel 

207 

207 

Engine  Fluids 

114 

115 

Chaff,  Ammunition 

252 

252 

Miscellaneous 

58 

58 

i  Operating  Weight  Empty 

25,770 

25,771 

Missiles 

1,410 

(2)  AIM-7F 

1,020 

(2)  AIM-9L 

390 

Mission  Fuel 

10,860 

10,857 

Takeoff  Gross  Weight 

38.040 

38,038 
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Economic  Assumptions 


,  MALCCA  (Military  Aircraft  Life  Cycle  Cost  Analysis)  in-house 
code  used  to  determine  notional  aircraft  economics 

*  Baseline  File  created  starting  with  defaults  based  on  the  military 
aircraft  assumptions  (primarily  sourced  from  F-15  and  F-16  data) 


Inflation  Factor 
Dollar  Year 

Year  of  Program  Initiation 
Final  Year  of  Production 
#  Operational  Vehicles 
System  Economic  Life 


3.3% 


2000 

2023 

2530  units 
20  years 
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Breakdown  of  Responses  to  Describe  a  Vehicle 


Top-Level 
requirements  related 
to  the  mission 


Design  Variables, 
Economic  Variable 
and  Vehicle  Attributes 


- ^ r - 

Response  (i.e.  GW)  =  function  (Requirements,  Vehicle  Character! sties,  kTP,  k- 


To  cope  with  this  large  problem,  evaluate  it 
in  “ snapshots ”,  where  most  inputs  are  held 
constant  while  a  subset  of  the  inputs  varies 

This  approach  allows  the  consideration  of 
mission  requirements  and  applied 
technologies  along  with  the  geometry  of  the 
vehicle 

Snapshots  1,2,3  provide  “deltas”  in 
responses  wrt  baseline 


Technology  k-factors 
(related  to  performance 
and  to  manufacturing) 


Use  Response  Surface 
Method  once  again  ! 
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and  Top  Level  Requirements 


Range  Payload  Ps  tloj,„  turn  rale  Afw  Awlw  Mach 

Top  Level  Requirements 


Example  Responses; 

Gross  Weight 
Probability  of  Survival 
Lethality 
O+S 

Acquisition  Cost 

Approach  Speed  (constraint) 
TOFL  (constraint) 


TAV  and  W/S  may  belong  in 
either  the  requirements  or  the 
responses  section  -  depending 
on  how  the  programs  are  set  up 


This  approach  de-emphasizes  the  geometry  of  an  aircraft,  and  instead  focuses  on  the  mission  requirements. 
However,  it  does  require  a  baseline  aircraft  configuration.  Geometry  and  Technologies  are  fixed,  while 
Requirements  vary.  Each  vector  of  top  level  requirements  maps  to  a  specific  mission. 
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Effects  of  Increase  in  Combat  Radius  Req. 


Decreasing  145 
Feasible  2M 
Space 
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Exploring  the  Space: 
j  Capturing  the  F/A-18E/F  ! 


iii  ill 


ii 
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umm 


Di  Dimiin  Mavris  t  Di  Dan  DeLaurentis 
Georgia  Institute  of  Technology 
Atlanta.  GA  30332-0150 
www.asdl .gatech.edu 


Area  (ftA2) 

1999  ONR  Grant  Review-  Aerospace  Systems  Design  Laboratory  (ASDL) 


2 


Responses  vs.  Vehicle  Characteristics 

"  . . . . “ . . .  . . 

.  Snapshot  2 
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DV]  DV2 

Design  Variables 


EcVl  EcV2 

Economic  Variables 


Geometrv/A  ttribute  relationship: 


Turbine  Inlet 
Temperature 
(TIT) 


Specific  Fuel 
Consumption 
(SPC) 

Engine  Cycle 
Variables 


TAV  W/S 

Attributes 


Vehicle  Characteristics 


Here,  the  Requirements  and  Technologies  are  fixed,  but  the  vehicle 
characteristics  are  allowed  to  vary.  Each  vector  of  Design  Variables,  Economic 
Variables  and  Attributes  maps  to  a  specific  geometry  of  a  configuration. 
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Technology  k-factors 


Here,  the  Requirements  and  the  Vehicle  are  fixed,  but  the  technologies  are  allowed  to 
vary  Each  vector  of  technology  k-factors  maps  to  a  specific  combination  of  applied 
technologies. 
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Additive  Creation  of  the  Overall  Equation 


Fix  all  other  groups 
(vehicle  and  technologies) 
and  let  only  one  group 
(requirements)  vary 


A  gw  =  {b{\  +  X(r^  *•  re(i2' 


Fix  all  other  groups 
(requirements  and  vehicle) 
and  let  only  one  group 
(technologies)  vary 


A  GW'  =  {f>u\„k+^t{k„i,k„2,..,tkni],kn,v. 


"Response  (IT  dGW)  =  function  (Requirement^,  Vehicle  Characteristic^,  kTP,  kTM| 


Fix  all  other  groups 
^'(requirements  and  technologies)  j 
and  let  only  one  group  • 
(vehicle  characteristics)  vary  • 


AGW  =  (/>,  .\,h  +  £(Z>V  1,  DV2 EV1.EV2 . Anr),Anr2,...) 


Then: 


GW^bX^l^re^.req,...  )+S(/>M.PV, . £ti£Vi . . 


This  equation  can  now  be  re-solved  for  any  parameter  that  might  be  ofinterest 
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Is  there  a  Solution?? 

. .  - - - — 

The  set  of  coupled,  non-linear  RSEs  can  be  used  to  determine  if  a  solution  exists  for  given 

metric  targets 

*.  =  •  «*■  . . . > 


n  non-linear 
Objective/Constraint 
RSEs  in  m  unknowns 


Objective  Targets 

R 


Non-linear,  simultaneous 
equation  solver/ 
constrained  optimizer 
(e.g.  Matlab) 


Determine  values  of  design  variables, 
requirements,  and  technology  levels 
that  produce  objective  targets 


Purpose 
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One  Example  Application  on  the  Notional  F/A-18C 


Objective: 

Minimize  the  Gross  Weight  of  a  multirole  fighter  (Notional  F/A-18C  baseline) 


Equality  Constraint: 

Required  Primary  Mission  radius  =  357  nm  (+15%  from  baseline) 
Required  Delta  Weight  for  Stealth  =  500  lbs. 


Inequality  Constraints  (deltas  with  respect  baseline): 

AAltRng  >  4%,  AOEW<-4%,  A$0&S<-3%,  APS>2%, 

ATurnRt  >  3%,  ATumRad  <  -3%,  AWOD  <  -3  knots 

Free  Variables: 

Requirements:  Ult.  Load  Factor,  Combat  Mach,  Payload,  Thrust,  Wing  Area,  Aux.  Tanks 
Technology  K-Factors:  Minimum  Drag,  Induced  Drag,  Wing  Weight,  Fuselage  Weight, 
Vertical  Tail  Wt.,  Horizontal  Tail  Wt.,  $RDTE,  $1st  Unit  Prod.,  $0&S 
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The 

const  raints/object  i  ves/targets 
can  be  quickly  changed 
and  the  optimization 
re-executed 


Screenshots  and  Example  Results 

Results: 

Objective: 

AGW  =  -8.8% 

Inequalities: 

AAltRng  =  6.9% 

AOEW  =  -10.1% 

A$0&S  =  -3% 

APs  =  3.6% 

ATurnRt  =  4.8% 

AT  urnRad  =  6.7% 

AWOD  =  6  knots 


!  £3  *•»  <M~9 

o  <$5 . }  ■■  r  a  t  *  v  • 


^ - 7—. 

Analysis  routines 
created  in  MATLAB^ 
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Puture . Incorporating  Probabilistics: 

Achieved  vs.  AnticipatedRegyirem^Tts 


One  Requirement  -  1-Dimensional  Plot 


Achieved 


Anticipated 

Requirement 


Requirement 


Range  of  Satisfied 
Requirement 


P( Satisfying  Requirement) 

=  P{  ReqAn!ldpMcd  '  Achieved  >  ^  ) 
=  P(  RD  >  0  ) 
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/^Satisfying  Requirements) 

-  P(Req  Arhics-eit  ”  ^eQA«li'rip«l<’rf  > 

=  p{rd  >  o) 


Two  Requirements  -  2-Dimensional  Plot 

Anticipated 
Requirements 

Area  of  Satisfied 
Requirements 


Requirement  1 
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7.  Introduction  and  Research  Setting/Summary 

2.  Overall  Technical  Approach  for  Affordable  Systems  Design 

3.  Methods  Implementation  and  Testbed  Applications 

4.  Key  Advancements  in  Method  Components 

5.  Conclusions/Summary 
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Section  4 

Part  B: 

Investigation  of  Advances  in  Soft 
Computing  and  Mathematical 
Sciences  for  Affordability 
Measurement  and  Prediction 
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Tasks 

•  Main  Tasks: 

development  of  a  comprehensive  database  of  key  characteristics, 
relevant  bibliographies,  and  clear  identification  attributes  and  limitations 
as  to  these  techniques. 

-  ...  for  each  examined  technique,  definitions,  maturity  status,  data  on 
leading  scientists  and  organizations  advantages  and  problems,  software 
implementation,  practical  applications  and  ‘pointers’  to  the  problems  to  be 
addressed  within  the  affordability  science. 

•  Main  Assumptions: 

-  ...  customer’s  concept  of  affordability 

-  ...  no  more  than  1 0  - 1 5  areas  and  a  certain  period  of  time  due  to  diversity 
and  dynamism 

•  Results: 

-  Comprehensive  database  of  important  modem  mathematical  techniques 
and  their  characteristics  as  applicable  to  affordability  science. 

-  Recommendations  on  use,  limitations  and  desirable  development  of 
mathematical  techniques  with  respect  to  affordability 

Dr  Dimitri  Mavris  /  Dr  Dan  DeUurenlis  _  _ 

Georgia  Institute  of  Technology  ^ Z  ,  ,  , _ 

Atlanta.  CA  30332-0150  1999  ONR  Grant  Review-  Aerospace  Systems  Design  Laboratory  (ASDL) 

wwv.asdl.gacech.edu 


Research  Motivation? 

•  Find  elements  that  can  serve  as  a  formal  foundation  for  affordability  science 

•  Selected  the  areas  of  investigation  so  as  to  have  a  broad  range  of  application 
domain  to  address  a  wide  variety  of  problems. 

.  Organize  this  broad  range  into  categories  and  identify  their  primary  area  of 
concern  on  a  higher  level. 

.  Map  critical  areas  in  affordability  science  which  would  benefit  from  additional 
methods  to  the  categories  of  solution  techniques. 

This  will  yield 

o  The  areas/categories  which  are  the  most  critical  to  the  affordability  science  on  a 
higher  level 

o  A  better  understanding  and  greater  insight  as  to  where  each  of  these  techniques 
stands  and 

o  How  they  can  be  used  to  have  the  greatest  positive  impact  on  affordability 
science,  and  science  and  society  in  general. 
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Overview/Summary  of  Investigated  Areas 

Method 

Description 

Applications 

Rough  Sets 

Uncertainty  Management 

Upper  and  Lower  Approximations 

Uncertainty  representation,  knowledge  analysis  and  analysis  of 
conflicts,  identification  of  data  dependencies,  Information- 
preserving  data  reduction 

Artificial  Neural 

Networks 

Pattern  Recognition  and  Function 
Approximation,  Non-linear  Regrcssior 

Approximate  Reasoning,  Pattern  Recognition,  Function 

Approximation, Time-Series  Prediction 

Genetic  Algorithms 

Genetics  and  Chromosome 
representation ,  Evolutionary 
Algorithms 

Global  Optimization.  Applicable  to  discrete  variables  and 
parameters,  Genetic  Representation 

Fuzzy  Logic 

Fuzzy  vs.  Crisp 

Uncertainty  Representation 
Approximate  Reasoning 

Representation  of  incomplete,  uncertain  or  partially 
true  knowledge,  Knowledge  Management; 

Approximate  Reasoning 

Chaos  Theory  and 

Theory  of  Fractals 

Dynamical  Systems 

Fractal  Structures 

Dynamical  Systems,  Chaotic  Behavior,  Image  Coding, 

Wavelets 

Granulation  and 
Aggregation 

Granular  Computation 

Clustering.  Approximate  Classification.  Optimization: 

Approximate  Reasoning 

Game  Theory 

Decisions  players  make  in  a 
well-defined  game 

Analysis  of  strategic  concepts.  Partial  Prediction  on  partial 
knowledge.  Decision  Support 

Ordinal  Optimization 

Ranking  and  Optimization 

Method 

Optimization;  Ranking.  Selection  of  the 
best’ 

Semiotics 

Signs  similar  to  those  used  in  natural 
languages 

Analysis  of  language.  Linguistic  Concepts, 

Logic  of  Signs 

Expert  Systems. 

Reasoninc:  Diagnostics.  Certification. 

D““"  ASDl  k 

kmnilrJgr-llun] 

Systems 

Knowledge-  or  Rulebasc, 

Inference.  Reasoning 
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Level  of  Application  of  a  Method 

•  Ranks  the  techniques  relative  to  each  other  between  the  two  extremes 

-  A  may  be  more  specifically  tailored  to  an  application  or 

-  A  method  encompasses  fundamental  and  basic  principles 

•  Compare  only  those  on  the  same  or  a  similar  level  of  application 

•  Techniques  on  different  or  the  same  levels  of  application  may  build  on  each  others 
principles  or  be  integrated  as  hybrids 

•  Basic  techniques  with  a  low  level  of  application  are  fundamental  notions,  they 

-  generally  require  more  work  to  be  applied  than  those  with  high-level 
applications  already  specified  and 

-  can  usually  be  applied  to  a  much  wider  range  of  problems  than  high-level 
specific  applications 

•  Techniques  which  evolve  from  a  fundamental,  basic  stage  to  one  or  more  high- 
level  applications  may  all  be  known  under  the  same  name 

•  The  Level  of  Application  marks  the  first  dimension  in  the  classification  scheme 
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I  How  broad  is  the  range  from  theory  to  application? 

A  sample  of  techniques 

Method 

Description 

Application  Level 

•  Artificial  NN 

Computational  methods 

procedure 

•  Chaos 

Dynamical  Systems 

specific  basic 

•  Fractals 

Mathematical  representation 

specific  basic 

•  Fuzzy  Logic 

Mathematical  notion 

basic 

•  Game  Theory 

Modeling  Strategy  Situations 

application 

•  Genetic  Algorithms 

Discrete  Optimization 

application 

•  Aggregation/Granulation 

Clustering  and  Optimization 

basic,  application 

•  Expert  Systems 

Reasoning 

procedure 

•  Ordinal  Optimization 

Ranking  Optimization 

application 

•  Rough  Sets 

Mathematical  notion 

basic 

•  Semiotics 

Signs  and  Language  notion 

basic 
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More  applied  and  specific 


Other  Web  Sites  of  Interest 

7k  * “ 
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rfVi  § 
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Summary 


•  Database  of  methods  and  key  characteristics 

-  In  electronic  form,  available  on  the  web 

-  Summary  write-ups  for  each  technique,  addressing  function,  type  of 
implementations  and  other  summary  information  and  characteristics 

-  Reference  Bibliography  for  each  technique 

•  Method  for  classification  of  techniques  according  to  ‘dimensions’,  such  as 

-  Level  of  Application 

-  Problem  Domain  in  terms  of  decision  making 

-  Select  Techniques  to  apply  and  give  further  consideration 

•  Application  examples  of: 

-  Genetic  Algorithms  for  Technology  Impact  Forecasting  (high  application  level, 
optimization) 

-  Artificial  Neural  Network  for  Metamodel-building  (medium  applicationlevel, 
function  approximation) 

-  Fuzzy  Logic  to  Possibilistics  for  uncertainty  management  (basic,  low  application 
level  with  broad  range) 
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Section  4 


Part  C: 

Stochastic  Methods 
Research 
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Stochastic  Methods  Task  Summary 


Main  Objective:  To  define  the  requirements  and  identify  the 
specific  tools  for  the  transition  from  a  probabilistic  decision¬ 
making  mechanism  for  Affordability  to  a  stochastic  environment. 

Specific  Tasks: 

•  Establish  the  need  of  a  time-varying  model  (current  shortcomings) 

•  Identify  the  needed  elements  of  a  proper  stochastic  approach 
including  mathematical  tools,  decision-making  models,  etc, 

•  Recommend  ways  that  the  environment  assists  (not  hinders)  the 
making  of  rational  decisions  (resource  allocations) 
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Why  Stochastics  ? 


♦  Technology  readiness  changes  in  time 
4  Fidelity  Uncertainty  changes  in  time 
4  Customer  requirements  change  in  time 

4  Fitness  landscapes  (i.e.  objective  function  surfaces)  change  in  time 
4  Operational  environment  changes  in  time 
4  Budget  allocations  change  in  time 

. Bottom  line:  Both  deterministic  and  probabilistic  variables 

involved  in  identifying  and  designing  affordable  systems  evolve  in  time. 
Stochastic  methods  are  needed. 
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Analogies: 

Common  Applications  of  Time  Series  Prediction 


•  Weather  forecasting 

•  Sales  forecasting 

•  Economic  forecasting  (i.e.,  price) 

•  Stock  market  forecasting 

•  Manufacturing  forecasting 

•  Prognostic  of  incoming  failures 

•  etc. 
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Issue:  Prediction  of  Stochastic  Systems 

What  is  time  series  prediction  ? 

•  Time  series  prediction  -->  find  the  future  values  {xN+I, 
xN+2,  ...}  Given  (x,,  x2,  ...,  xN},  where  xt  is  the  series  value 
sampled  at  time  t. 


(Takens,  1981)  If  the  series  is  deterministic,  there  exists 
d,  rand/(  •)  such  that  for  every  t>  (d  ■  r) 
x,  =  f(xt.  T,  xt_  2z,  Xt_  jT  ) 


Unfortunately,  there  is  no  exact  method  to  find  d,  T  and 
f(-)  when  the  series  is  too  small  (less  than  10*  samples  for  d 
and  t) 
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Shortcomings:  Current  Prediction  Methods 


•  There  are  major  weaknesses  with  current  time-series  methods 
need  to  be  overcome: 

•  Generally  only  valid  for  very  short  term  prediction  (i.e.  can 
only  predict  next  steps  xN+I,  xN+2 } 

•  Lack  ability  to  incorporate  causality,  especially  through 
reasoning/leaming 

•  Studies  under  this  grant  focused  on  advanced  time-series 
prediction  methods.  In  particular,  a  neural-network  model  is 
under  development  for  the  prediction  of  airline  load  factor  and 
fuel  price  based  on  historical  data  and  cause/effect  relationships 
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The  Classical  Approach 


Many  time  series  can  be  modeled  by  two  simple  models 

•  Autoregressive  (AR) 

Z,  =  <Pq  +  0lZ(-|  +  02^;-2  +  •••+  ai 

•  Moving  average  (MA) 

Z;  =  +  @iat-l  "b  @2at-2  +•••■*" 

•  Combination  of  two  models  (ARMA) 

Z,  =0O  +  0,ZM  +  ^2Z,_  2  +  ...+  0|fl,_i  +  #>ar-2  +--  +  <3, 
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RPM  Prediction  (cont.) 


Feed-forward  neural  network  results: 

Trend  can  be  captures,  but  without  causal  factors,  oscillation 
for  short  term  prediction  is  impossible 
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Representation  of  Stochastic  Processes 

Motivation 

Information  must  be  readily  available  at  all  times  during  decision-making 
processes 

Information  is  stochastic  and  highly  dynamic 
Information  must  be  easily  transformed  into  knowledge 
Information  is  distributed  and  very  large  amounts  exist 

Research 

Study  methods  for  representing  stochastic  processes  in  the  context  of 
decision-making 

Findings 

Evolutionary  modeling  techniques  exist 
Difficulty  in  identifying  axis  of  change;  area  for  future  research 
Results  from  ONR  base  research  plays  a  key  role  in  the  structure  of  the 
information  model 


Dr.  Dimitri  Mavris  /  Dr.  Dan  DeLaurcntis 

Georgia  Institute  of  Technology _ 

Atlanta.  GA  30332-0150  — ■ 

www  asdl  gatech.edu 


1999  ONR  Grant  Review-  Aerospace  Systems  Design  Laboratory  (ASDL) 


Definitions  in  the  Context  of  this  Research 

P :  X  •  as©58ga3*5IKr?^*B3  W'A  TC  ~-V-AZP3&';.-  :'  ’.&■'*&.'<$ T*  r'"  *&  -T? 

•  Information 

A  collection  of  data  describing  products  and  processes. 

•  Knowledge 

Information  in  context. 

•  Transaction 

A  valid  action  that  has  occurred. 

•  Event 

A  transaction  that  happens  at  a  specified  time. 
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Evolutionary  Data  Structures 

. m ■m&zs&tsestz :  srws  « 

•  Current  database  technologies  using  linked-lists  can  be  used 
to  store  forecasting  information. 

Distributions  can  be  stored  in  Linked  list  structures  can  be  Object  must  be  able  to  store 

objects  and  keyed  to  time  - *  used  to  store  information  as  it  *  both  stochastic  history  and 

evolves  over  time.  This  is  discrete  event  as  well  as 

needed  so  that  decision-  return  appropriate  result  when 


Additional  Forecasting  Scenarios 

•  The  following  scenarios  are  expected  in  forecasting.  They  are  more  difficult 
to  map  and  manage  as  data  structures  and  require  further  investigation. 


Branching.  -  (Subject  oj  Current  Research} 
Decision  path  separation  because  of  budget 
constraints,  shift  in  requirements,  and 
technological  impacts 


Parallelism 

Multiple  decision  paths  can  occur  during 
technology  trades,  bidding,  and  multi¬ 
purpose  designs 


(A) Synchronization 

Decision  paths  may  not  be  synchronized  as  x < t ) 
tasks  are  delegated  to  different  groups  and 
technologies  are  evaluated  as  they  matures 
Decision  paths  may  be  done  independently 

t+at+b  .  Time 
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Formulation  of  a  Stochastic  Object  Framework 

•  Preliminary  Findings 

-  Advantages 

•  Permit  storage  of  both  stochastic  and  deterministic  information 

•  Sound  temporal  framework  exists  for  managing  information 

-  Disadvantages 

•  Assumes  time  is  the  axis  of  change 

•  Complex  decision  making  paths  difficult  to  implement  and  manage 

•  Characteristics  of  a  Stochastic  Object  Framework 

-  Transaction-Based 

•  Allows  for  non-temporal  considerations  to  affect  events;  Situation  Calculus 
is  necessary  for  modeling  transactions  and  their  relationship  to  time 

•  Multiple  axes  of  change  can  be  modeled 

-  Evolutionary 

•  Permit  storage  of  deterministic  and  stochastic  information  in  same  structure 

•  Permits  growth  from  a  data  set  with  few  sparse  points  to  a  fully  populated 
legacy  data  history 

Dr .  Dimitri  Mavris  !  Di  Dan  Del  jurentis 
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More  on  the  Axis  of  Change 


•  During  the  course  of  the  preliminary  research,  the  time  axis 
presented  difficulty  when  time  was  used  as  a  key  for  tracking 
decision  making  actions.  Time  is  important  for  forecasting 
but  may  not  be  relevant  for: 

-  Predictions 

-  Comparisons 

-  Forecasting  across  multiple  domains 

-  Other  decision-making  processes 

•  More  research  needs  to  be  done  on  quantifying  other  axes  of 
change. 
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Some  “Axes  of  Change”  within  an  Enterprise 


Absolute  Time  ,99Q2  |  t99Q4  .  OOQ3  01Q3 

How  does  design  A  U  u  |  *  o  *  a  *— o 

compare  against  Conceptual  Preliminary  Detailed  Manufacture 

the  others?  Can  I  j 

down  select?  • 


Relative  Time 

I’ve  had  two  hours 
to  get  an  answer, 
how  does  my 
answer  compare? 

Similarity 

The  other  design 
includes  sub¬ 
systems,  is  mine 
consistent? 

Model  Size 

My  analysis  is 
based  on  a  200 
node  FEM  and  the 
other  is  100  node, 
should  more  be 
used? 
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Same  Da\  Next  Day 


Gross  Components  Sub-Systems  Identified  Internal  Layout  Store  Types 


100  Nodds  1,000  Nodes 


1,000,000  Nodes 
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Summary  of  Issues 

•  Tied  to  Stochastic  Modeling 

-  Can  temporal  methods  be  extrapolated  to  other  axes?  How  are 
decisions  impacted? 

-  Which  axis  of  change  is  needed  for  a  particular  decision  type 
or  class? 

-  How  can  decisions  be  mapped  against  the  axes?  How  can  the 
axes  be  mapped  against  each  other? 

•  Other  Issues 

-  Investigation  into  information  quantity  and  quality.  How 
much  data  is  needed?  When  is  extrapolation  acceptable? 

-  Identify  situations  where  real-time  and  near  real-time 
information  storage  are  applicable. 
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Section  4 


Part  D: 

Decision  Tree  Networks 
Research 
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Stochastic  Decision  Trees:  Motivation 


Uncertain  system 
state  (fuzzy, 
stochastic, 
non-linear,  ..♦) 


Time  (Schedule) 


*  Performance 

The  dynamics  of  the  future  “project  (venture)  -  external  environment”  system  is  complex  and  uncertain. 
In  affordability  studies,  three  classes  of  metrics  are  to  be  taken  into  account  simultaneously:  time,  cost, 
and  performance. 

The  following  types  of  relationships  are  characteristic  to  the  system:  T,  ~f  (T ),  C*,  P/),  C{-  =/(T/-,  Ck ,  P/), 
and  P,  =/(Tj"  C*,  P,),  where  T,  is  time,  Ck  is  cost,  and  P,  is  performance  of  activities  (processes)  and 
events  (milestones),  which  constitute  the  system  structure. 

This  Tri-Variate  (Time  -  Cost  -  Performance,  or  T/C/P)  Affordability  Problem  needs  the  metrics  on  all 
three  axes  to  be  quantified  intelligently.  The  objective  of  the  decision  maker  is  to  search  for  potentially 
optimal  and  critical  alternatives  and  paths  in  the  system  dynamics. 

Adequate  analytical  methods  are  required  to  derive  and  examine  these  relationships 
in  affordability  studies 
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Task  Connectivity 


TIES 

Method 

Output 


Fuzzy-Stochastic 
Decision  Tree- 
Network 


TIES  Analysis  ^ 

*  Technology  Impact  Forecast  Equations 

*  Technology  Confidence  Estimates  (TRLs) 

*  Feasibility /Viability  Estimates 

—Ik.  The  TIES  method  generates  input  information  for  the  tree-network  in  form  of 
specifications  of  activities  (processes)  and  events  (milestones) 

VERT-3F  Fuzzy  Stochastic  Modeling  Method 

*  Information  mapping  and  integration 

*  Simulation  of  system’s  life  cycle  logic,  constraints  and  objectives  (failure  and  success  conditions) 
using  time,  cost  and  performance  metrics  and  their  relationships 

wgk  Fuzzy-stochastic  tree-network  models  simulate  the  ‘‘project-environment”  life  cycle 
dynamics  under  uncertainty 
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Project  Details  (Case  Study) 


Project’s  life  cycle  phases  (network  models) 

PI  (N 1):  new  technologies  RDT&E  phase 
P2  (N2):  vehicle  design  phase 

P3  (N3):  test  article  production,  T&E.  and  certification  phase 
P4  (N4):  vehicle  production,  operation  &  retirement  phase 


New  technologies  (77, T4) 

Tl:  High-temperature  composite  wing  -  to  reduce  weight  and 
improve  temperature  tolerance 

72:  Circulation  control  -  to  improve  the  vehicle's  takeoff  and 
landing  performance 

T3 :  Hybrid  laminar  flow  control  -  to  reduce  high-speed  flight 
drag 

T4 :  Advanced  engine  concept  -  to  reduce  engine's  s.f.c.,  and 
noise  and  emissions  levels 


New  technologies  performance  metrics 

1.  Tl  -  High-temperature  composite  wing: 

Y3 1 :  Wing  weight  reduction.  % 

Y12:  Surface  work  temperature  increase,  °K 

2.  T2  -  Circulation  control: 

Y21:  Lift-over-drag  force  increment,  % 

Y22:  Thrust  losses,  % 

3.  T3  -  Hybrid  laminar  flow  control: 

Y31:  Supersonic  drag  coefficient  reduction,  % 

Y32:  Subsonic  drag  coefficient  reduction,  % 

4.  T4  -  Advanced  engine  concept: 

Y41:  Specific  fuel  consumption  reduction,  % 

Y42:  Fly-over  noise  reduction,  EPNdB 
Y43:  Side-line  noise  reduction,  EPNdB 


System  alternatives  (VO, V14) 

VO  (baseline)  =  none  of  technologies  is  used 

VI  =  Tl 
V2  =  T2 
V3  =  T3 
V4  =  T4 

V5  =  Tl  +  T2 
V6  =  T1  +T3 
V7  =  Tl  +  T4 
V8  =  T2  +  T3 
V9  =  T2  +  T4 
V10  =  T3  +  T4 

VII  =T1  +T2  +  T3 
V12  =  Tl  +T2  +  T4 

d  V13  =T2  +  T3  +  T4 
J  V14  =T1  +T2  +  T3  +  T4 

wL  asdl.gateeh.edS - ’ - “ - JYW  17IW  WOHTW 


System  level  metrics 

L  Flight  performance  metrics  group  (Ml . M4): 


Ml:  Landing  Approach  Speed 

Vu 

<155 

kts 

M2:  Landing  Field  Length 

LFL 

<11,000 

ft 

M3:  Takeoff  Field  Length 

TOFL 

<11.000 

ft 

M4:  Takeoff  Gross  Weight 

TOGW 

<1,000,000 

lbs 

2.  Environmental  performance  metrics  group  (MS,  M6): 

M5:  Fly-Over  Noise  (Stage  III) 

FON 

<106 

EPNdB 

M6:  Side-Line  Noise  (Stage  III) 

SLN 

<103 

EPNdB 

3.  Economic  performance  metrics  eroup  (M7, 

....  M10): 

M7:  Aircraft  Acquisition  Price 

Acq$ 

Minimize 

FY9SSM 

M8:  Required  Yield  per  RPM 

S/RPM 

<  SO.  1 3  (*) 

FY98SM 

M9:  Direct  Operating  Cost  Per  Trip 

DOC/T 

Minimize 

FY98SM 

M10:  R&D,  T&E  Costs 

RDTEC 

Minimize 

FY98SM 
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Vehicle’s  Life-Cycle  Tree-Network  Models 


Nl:  New  Technologies  Research  Development,  Testing  &  Evaluation  (RDT&E)  Phase 


SPl:  technology  \  SP2:  technology  \  I  SP3:  technology  tcsl  \  SP4:  technology  \  SP5:  technology  time  and  cost  check,  \  SP6:  alternatives 
feasibility  studies  /  |  design  /  }  article  fabrication  /  performance  testing  /  aod  paformance  evaluation  /  |  feasibility  check 


N2:  Vehicle  Design  Phase 


SPl:  Conceptual  \  SP2:  preliminary  \  :SP3:  detailed  design  \  SP4:  system  level  metrics  modeling  \  SP5:  overall  performance  assessment 

design  /  design  /  ami  systems  integration  /  |  and  simulation  and  check  /  |  and  decision  makipg _ 


N3:  Test  Article  Production,  Testing,  Evaluation  and  Certification  (PTE&C)  Phase 


SPl:  airframe  parts 
Bianttfaaunpg 


SP2:  vehicle’s  systems 
roaoufactartng/suppty  , 


SP3:  components 
assembly  . 


SP4:  final  assembly  and 
assembly  quality  check 


SP5:  vehicle 
testing  ']■} 


SP6:  performance, 
time  &  cost  evaluation 


SP7:  vehicle 
certification 


N4:  Vehicle  Production,  Operation  &  Retirement  Phase 


SPl:  vehicle 
production 


SP2:  flight  ;  SP3:  vehicle 
operation 
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VERT-3  Modeling  and  Simulation  Process 

Step  1.  Decision  situation  formalization 

Define  the  problem,  define  success  and  failure  conditions  and  decision  criteria,  establish 
the  alternatives  to  solve  the  problem 

Step  2.  Flow  network  specification 

Formulate  the  model,  specify  main  activities  and  events  of  the  “venture  -  external 
environment”  system  dynamics 

i**'  ;  ' 

Step  3.  Input  data  collection  .  .  _  _  ..... 

Collect  the  data  on  main  activities  and  events,  represent  the  data  in  the  form  of  probability 
distributions,  histograms,  and/or  mathematical  relationships 

<L>  ’•  ’ 

X> 

Step  4.  Tree-network  programming  J  J  L  ,  .  . 

Translate  the  tree-network  model  into  VERT  input  system,  program  and  debug  the  model 

.  v> 

O 

a 

Step  5.  Network  verification  and  validation 

Verify  and  validate  the  model,  conduct  sensitivity  (“what-if ’)  analysis 

(D 

Ut 

. «  ' 

Step  6.  Network  simulation  and  results  analysis 

Design  the  simulation  experiments,  conduct  the  experiments,  process,  and  analyze  results 

: ,  ' 

.  C3 

Step  7.  Alternatives  selection 

Compare  alternatives,  identify  the  worst  and  the  best  outcomes  (cntical/optimum  paths) 

V 

Step  8.  Results  generalization  and  communication  . 

Present  the  final  study  to  the  decision  maker  in  a  concise  format;  make  recommendations 
regarding  those  activities  and  milestones  and  their  parameters,  which  are  time,  cost  and 
performance  drivers  on  both  critical  and  winning  paths;  estimate  project’s  overall  risk  and 
success  under  key  uncertainty  hypotheses  (scenarios) 
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Section  5 

1.  Introduction  and  Research  Setting/Summary 

2.  Overall  Technical  Approach  for  Affordable  Systems  Design 

3.  Methods  Implementation  and  Testbed  Applications 

4.  Key  Advancements  in  Method  Components 

5.  Conclusions/Summary 
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Summary  of  Year  2  Results 

1.  Significant  enhancements  to  the  TIES  affordability  environment  est.  in  Year  1 

♦  Pilot  Studies:  Environment  prototype  for  Navy's  F-J8C,  NASA ’s  HSCT,  a  notional  150  pax 
transport,  and  a  short-haul  civil  tiltrotor 

♦  JPDM  incorporation  and  validation ;  n -variate  math  model  constructed 

♦  Genetic  Algorithm  for  technology  combinatorial  selection  problems 

♦  Fuzzy  Decision  tree  constructed  to  treat  stochastic  affordable  technology  selection  problem, 
an  evolution  of  TIES  to  include  schedule/cost  as  well  as  performance 

2.  Completion  of  the  investigative  research  into  mathematical  and  soft  computing 
techniques  and  stochastics,  resulting  in: 

♦  Web-based  database  of  advanced  math  and  soft  computing  techniques  relevant  to  affordability 
measurement  and  prediction,  including  current  investigators,  computer  codes,  and  transition 
status 

♦  Several  implementations  of  methods  (Fuzzy  sets,  GA  ’s,  Neural  Networks ) 

♦  Roadmap  towards  stochastic  methods  established,  research  goals  prioritized 

3.  A  powerful  mathematical  tool  to  examine  the  simultaneous  impact  of  vehicle 
requirements  &  technologies  has  been  created  and  initially  tested  on  a  F/A-18C  case, 
including  carrier  suitability  constraints. 


4.  Methods  have  been  integrated  in  Graduate  level  curriculum 
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Key  Research  Innovations 

Recognizing  the  need  for  a  physics-based,  quantitative  link  between 
affordability  metrics,  uncertainty;  and  technology  infusion,  the  use  of 
disciplinary  metric  k-factors  wa£  a  breakthrough  in  facilitating  affordability 
decision-making  \  /  \ 

*  Recognizing  the  need  for  a  rapid,  accurate  assessment  of  system  feasibility  and 

viability,  the  “5-Step  Feasibjlity/Viability”  process,  including  TIES,  was  an 
important  breakthrough  ^  \  / 

>  A  mathematical  environment  collecting  requirements,  design  variables,  and 
technologies  for  simultaneous  examination  during  concept  formulation 

»  Recognizing  the  need  for  a  probabilistic  measure  that  did  not  have  the 
shortcomings  of  traditional  arithmetic  composite  objectives,  the  JPDM  was  an 
important  breakthrough 

•  Finally,  the  TIES  environment  was  a  “integration  breakthrough”  which 
incorporates  many  of  the  other  breakthroughs 
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ASDL  Gov’t/Industry  Technology  Transfer  (‘97-’01) 


ONR  Code  36  i 

Basic  Research  in  Affordability  Science! 


(Ongoing  and  planned) 


Gov’t/Industry 

NAVAIR-Pax  River 

NAVSEA-China  Lake 

NUWC 

STTR 

STTR 

Lockheed  Martin  (Ft  Worth) 

Boeing  (St.  Louis)/DARPA 
Boeing  (Long  Beach) 

NASA  Langley  SAB 

Air  Force  Research  Laboratory 
ONR/Boeing/Lockheed 
Rolls-Royce  Allison 
General  Electric  Aircraft  Engines 


Collaboration/Technology  Transfer 

-  Mngt.  Briefed;  Validation  study  with  F-18  or  JPATS 

-  Strong  interest  in  ASDL  methods  for  hypersonic  missile 

-  ASDL  methods  for  torpedo  validation  and  design  app. 

-  Affordability  for  Surface  Combatants 

-  Simulation-Based  Acquisition,  Affordability  Science 

-  UCAV  Technology  Impact  Forecast  (TIF) 

-  Manufacturing  (JSF) 

-  Application  to  Study  of  Synthetic  Jet  Tech. 

-  MUST  Cost  Initiative  for  C-17 

-  HSCT  TIF,  Subsonic  Transport  TIF 

-  Goal-Based  Outcome  Study 

-  UCAV  TIF 

-  Composite  Affordability  Initiative 

-  T-406/V-22  TIF 

-  Robust  Design  Simulation  Applications 


Atlanta.  GA  30332-0150 
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Grcnt  Publications  Update  (June  98  through  Oct.  ’99) 

Journal  Articles  submitted  and  accented: 

!.  Mavris,  D.N.,  DcLaurentis.  D.A..  Bandte.  O.,  Hale,  M.A.,  “The  Role  of  AI  in  a  New  Virtual  Aircraft  Design  Environment”  accepted 
and  to  be  published  in  special  issue  of  Engineering  Applications  of  Artificial  Intelligence  (EAAl),  estimated  publication  in  early  2000. 

Conference  Papers  presented  and  in  process  of  submittal  to  Journals  in  '99: 

1.  Mavris,  D.N.,  DcLaurentis,  D.A.,  “A  Stochastic  Design  Approach  for  Aircraft  Affordability,"  21st  Congress  of  the  International 
Council  on  the  Aeronautical  Sciences  (ICAS),  Melbourne,  Australia,  September  1998.  ICAS-98-6.1.3.  (intended for  AIAA  Journal  of 
Aircraft) 

2.  Bandte,  O  ,  Mavris,  D.N.,  DcLaurentis,  D.A.,  “Determination  of  System  Feasibility  and  Viability  Employing  a  Joint  Probabilistic 
Formulation”,  37th  Aerospace  Sciences  Meeting  &  Exhibit,  Reno,  NV,  January  1 1*14,  1999.  AIAA  99-0183.  (intended  for  AIAA  Journal 
of  Aircraft) 

3.  Mavris,  D.N.,  Kirby.  M„  Qiu,  S..  “Technology  Impact  Forecast  for  a  High  Speed  civil  Transport,”  AIAA/SAE  World  Aviation 
Congress  and  Exposition.  Anaheim,  CA,  September  28-30,  1998.  AIAA-98-5547,  (intended for ...  TBD) 

4.  Daberkow,  D.D.,  Mavris,  D.N.,  "New  Approaches  to  Conceptual  and  Preliminary  Aircraft  Design:  A  Comparative  Assessment  ot  a 
Neural  Network  Formulation  and  a  Response  Surface  Methodology",  World  Aviation  Congress  and  Exposition.  Anaheim,  CA. 
September  28-30.  1998.  SAE-985509 .  (intended for ...  TBD) 

5.  Mavris,  D.N.,  Kirby.  M..  “Technology  identification,  Evaluation,  and  Selection  for  Commercial  transport  Aircraft,”  for  presentation  at 
58th  annual  conference  of  Society  of  Allied  Weight  Engineers,  May  1999. 


To  be  presented: 

1.  Mavris.  D.N.,  Daberkow,  D.D..  "Knowledge  Representation,  Utilization  and  Reasoning  in  the  Conceptual  Aircralt  Design  Process. 
Abstract  submitted  to  the  World  Aviation  Congress,  San  Francisco,  CA,  Oct.  19-21,  1999. 


2.  Mavris,  D.N.,  Kirby.  M.R..  Daberkow,  D.D.,  "Technology  Evaluation  and  Selection  via  a  Genetic  Algorithm  Formulation  lor 
Aerospace  Systems."  Abstract  submitted  to  the  World  Aviation  Congress,  San  Francisco,  CA,  Oct.  19-21.  1999. 
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1999  ONR  Grant  Review-  Aerospace  Systems  Design  Laboratory  (ASDL) 


ONR  Grant:  ASDL  Ph.D.  Student/Staff  Support 


Number  of  Ph.D.  Students  Supported: 


Ms.  Debora  Daberkow  (ASDL) 
Ms.  Danielle  Soban  (ASDL) 
Ms.  Elena  Garcia  (ASDL) 

Ms.  Shobana  Murali  (Math) 
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Mr.  Oliver  Bandte  (ASDL) 
Mr.  Andy  Baker  (ASDL) 

Ms.  Linda  Wang  (ASDL) 
Mr.  Noppadon  Khiripet  (EE) 


Number  of  Masters  Students  Supported:  8 

Multidisciplinary  Professional  Team:  8 

Dr.  Dimitri  Mavris  (AE)  Dr.  Daniel  DeLaurentis  (AE) 

Dr.  Dan  Schrage  (AE)  Dr.  Mark  Hale  (AE) 

Dr.  Leonid  Bunimovich  (Math)  Dr.  George  Vachtsevanos  (EE) 

Dr.  Jimmy  Tai(AE)  Dr.  Ivan  Burdun  (AE) 

+  Over  40  students  exposed  to  methods  in  graduate  design  curriculum 


Dr.  Dimitri  Mavris  I  Dr.  Dan  DeLaurentis 
Georgia  Institute  of  Technology 
Atlanta.  GA  30332-OI50  — — — 

www  ardl  aatech  edu 
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